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Abstract. The toric fiber product is a general procedure for gluing two ideals, homo- 
geneous with respect to the same multigrading, to produce a new homogeneous ideal. 
Toric fiber products generalize familiar constructions in commutative algebra like adding 
monomial ideals and the Segre product. We describe how to obtain generating sets of 
toric fiber products in non-zero codimension and discuss persistence of normality and 
primary decompositions under toric fiber products. 

Several applications are discussed, including (a) the construction of Markov bases of 
hierarchical models in many new cases, (b) a new proof of the quartic generation of binary 
graph models associated to 7^4-minor free graphs, and (c) the recursive computation of 
primary decompositions of conditional independence ideals. 



1. Introduction 

Let / and J be ideals in polynomial rings K[x] and respectively, that are both 
homogeneous with respect to a single grading by an affine semigroup f^A. The toric 
fiber product of I and J (Definition 2.1), denoted / x_4 J, is a new ideal in a usually 
larger polynomial ring M\z\. An important measure of complexity of this operation is the 
codimension of the product, defined as the rank of the integer lattice ker^. In [32] the 
third author introduced toric fiber products and proved that in the codimension zero case 
it is possible to construct a generating set or Grobner basis for / J from generating 
sets or Grobner bases of I and J. In this case the algebra and geometry is significantly 
simpler essentially because codimension zero toric fiber products are multigraded Segre 
products (Definition 2.3), which share many nice properties with their standard graded 
analogues. Still in the codimension zero case, the geometry of the toric fiber product 
can be understood quite explicitly in terms of GIT [24] (Propositions 2.2 and 2.4). We 
pursue this observation and show that (under mild assumptions on K) normality persists 
(Theorem 2.5). 

The main goal of this paper, however, is to describe higher codimension toric fiber 
products. In Section 3 we show that primary decompositions persist in any codimension 
(Theorem 3.1). In Section 4 we show how to construct generating sets of toric fiber products 
in arbitrary codimension satisfying some extra technical conditions (Theorem 4.9). 

The toric fiber product frequently appears in applications of combinatorial commutative 
algebra, in particular in algebraic statistics [11, 29, 30]. Typically in algebraic statistics, 
we are interested in studying a family of ideals, where each ideal Iq is associated to a 
graph G (or other combinatorial object, like a simplicial complex or a poset). If the graph 
has a decomposition into two simpler graphs Gi and 6*2, we would like to show that the 
ideal Iq has a decomposition into the two ideals 1^ and • If we can identify Ig as a 
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toric fiber product Iqi 1^2, then difficult algebraic questions for large graphs reduce to 
simpler problems on smaller graphs. Our inspiration comes from structural graph theory, 
where the imposition of forbidden substructures often implies that a graph has a specific 
kind of structural decomposition into simple pieces. In Section 5 we pursue the analogy 
to the theory of forbidden minors [27] by exhibiting minor-closed classes of graphs with 
certain degree bounds on their Markov bases. 

Before proving our main theoretical results in Sections 2-4, we motivate our study with 
several examples from algebraic statistcs. Sections 5 and 6 contain new applications to 
the construction of Markov bases of hierarchical models, and to the study of primary 
decompositions of conditional independence ideals. 

1.1. Hierarchical models. Hierarchical statistical models are used to analyze associations 
between collections of random variables. If the random variables are discrete, these models 
are toric varieties, and hence their vanishing ideals are toric ideals. Their binomial 
generators — known as Markov bases — are useful for performing various tests in statistics [6, 
9]. From the algebraic standpoint, they are binomial ideals with a specific combinatorial 
parametrization in terms of a simplicial complex. 

Let r C 2^ be a simplicial complex on a finite set V and d G Z^g- Let facet (F) be 
the set of maximal faces of F. For an integer n, let [n] = {1,2, ... ,n}. For F C V" let 
dp = {dv)v£F and let Dp = Ylvepl^-"]- For i G Dy and F C V let ip = {iv)v&p be the 
restriction. For each F G facet(F) and i G Dj?, let af be an indeterminate. For each 
i G Dy, let Pi be another indeterminate. The toric ideal /r,d of the hierarchical model for 
(F, d) is the kernel of the K-algebra homomorphism 

0r,d : HP^ : ^ G Dy] ^ K[af : F G facet(F), j G D^] p,^ JJ af^. 

Fefacet(r) 

A fundamental problem of algebraic statistics is to determine generators for I^^. Results 
in this direction usually depend on special properties of F and d. An example is the 
following theorem of Krai, Norine, and Pangrac [20], which is also a corollary to our results 
in Section 5.3: 

Theorem 1.1. Let di = 2 for all i E V and let F be a graph with no minors. Then 
Iv,d is generated by binomials of degrees two and four. 

Combining our techniques with results from [14], we can also make statements about 
the asymptotic behaviour as the di grow. For instance, let F (IV be an independent set 
of F and consider /r,d as di tend to infinity for i E F, while the remaing di are fixed. In 
this case, there is a bound M(F, dv\p) for the degrees of elements in minimal generating 
sets of /r,d- Our techniques allow us to determine the values of M(F, dv\p), which were 
previously known only for reducible models or when F is a singleton [16]. Here is a simple 
example of how to apply Theorem 5.15. 

Example 1.2. Let F = [12] [13] [24] [34] be a four cycle, F = {1,4}, and d{2,3} = (2,2). 
The toric ideal Jr,d is a codimension one toric fiber product and its minimal generating set 
consists of the following four types of binomials, written in tableau notation (a common 
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notation, explained below Theorem 4.2): 
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where i, k.k, k, U £ [di], j, k E [2], /, k, h, h, h £ [d^]. In particular, M(T, dv\F) = 4. 

1.2. Conditional independence. If G is a graph on V, then its clique complex defines a 
hierarchical model as in the previous section. Probability distributions in this hierarchical 
model satisfy certain conditional independence statements associated to the graph [21]. 
One may ask which other distributions outside the hierarchical model also satisfy the con- 
ditional independence constraints, and algebraic statistics allows one to characterize these 
distributions. Consider again the polynomial ring K.[pi : i G Dy] with one indeterminate 
for each elementary probability, li A, B,C G V is a partition of V, i.e. pairwise disjoint 
with AUBUC = V, the conditional independence (Cl)-statement A JL B \C encodes that 
the random variables in A are independent of the random variables in B, given the values 
of the random variables in C. Distributions satisfying this constraint form a hierarchical 
model, which arises from the largest simplicial complex on V not containing {i,j} for any 
i E A,j E B. Its toric ideal is denoted Ia±b\c- A conditional independence model usually 
contains several statements and one is led to consider intersections of toric varities. Our 
main interest is in the global Markov ideal of a graph G, which is the sum of the toric 
ideals Ia±b\c for all A,B,C forming a partition of V such that C separates A and B 
in G. Our goal is to determine primary decompositions and as always we want to employ 
the toric fiber product machinery to split the problem into several easier problems. 

Example 1.3. Let G be the binary global Markov ideal of the graph in Figure 1. Since it 




Figure 1. Three squares glued along edges 

decomposes as three squares glued along edges. Theorem 3.1 and Corollary 3.2 reconstruct 
the primary decomposition from that of the Cl-ideal of a square. Our results also show that 
the corresponding Cl-ideal is radical, as it is composed of graphs with radical Cl-ideals. 
In total it is the intersection of 729 = 9^ prime ideals. 

A systematic check of all graphs with at most five vertices and with dy = 2 for all v E V 
found no examples of a non-radical global Markov ideal. This limited computational 
evidence motivates the following question: 



Question 1.4. Are global Markov ideals always radical? 
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The answer to this question is negative. More than a year after first submission of the 
present paper, Kahle, Rauh, and Sulhvant showed that the global Markov ideal of i^3,3 is 
not radical [19]. 

2. TORIC FIBER PRODUCTS AND MULTIGRADED SeGRE PRODUCTS 

Let r > be a positive integer and s,t e Z>q be two vectors of positive integers. Let 

K[x] = K[x) : ^ e [r], J e [s,]] and K[y] = K[yi : i e [r], k G [U]] 

be multigraded polynomial rings subject to a multigrading 

deg{x)) = degivl) = e Z". 

We assume throughout that there exists a vector w G Q"^ such that W"^a* = 1 for all i. This 
implies that ideals homogeneous with respect to the multigrading are homogeneous with 
respect to the standard coarse grading. Let A = {a^, . . . ,aJ'} and let NA be the affine 
semigroup generated by A. If / C K[x] and J C K[y] are N^-graded ideals, the quotient 
rings R — K[x]/I and S — K[y]/J are also N^-graded. Let 

K[z]^K[z%:ie[r]J e[siikeM 

and let -.Klz] R S be the K-algebra homomorphism such that zj^, i->- ® yl- 

Definition 2.1. The toric fiber product I xj^ J oi I and J is the kernel of 

I x^J ^ ker0/,j. 

The codimension of the toric fiber product is the dimension of the space of linear relations 
among A. 

We can also define the K-algcbra homomorphism : — )■ IK[x] ®k = IK[a;, y\ by 
z'jf, ^ x'^jVk- Then the toric fiber product is the ideal / J = 4>~^{I + J). 

2.1. The geometry of toric fiber products. If / x_4 J is a codimension zero toric fiber 
product, the relation between the schemes Spec (K[a;]/J), Spec (K[y]/ J) and Spec (K[2;]/(/x_4 
J)) can be explained in the language of GIT (geometric invariant theory) quotients. Since 
/ and J are homogeneous with respect to the grading by A, both Spec (K[a;]//) and 
Spec {K[y]/J) have an action of a (dim^ — 1) -dimensional torus T. Thus the product 
scheme Spec x Spec J) possesses an action of T via t • {x, y) — {tx, t~^y). 

Proposition 2.2. IfKis algebraically closed and A is linearly independent, then 

Spec {K[z]/{I x^ J)) ^ (Spec (K[x]//) x Spec {K[y]/J)) / /T. 
Proof. If K is algebraically closed, then 

Spec {K[x]/I) X Spec {K[y]/J) = Spec {K[x]/I (^k Hy]/J) 
Let R = K[x]/I and S = K[x]/J. Both it! and S are N^-graded, so we can write 

R = ®amARa, S = ©aGNy^l'S'a, and 

K[x]/I <S)K My]/ J = ®aeNAbeN^-Ra <S>K S^, 
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where the IjA degree of i?a ®k is a — b. The invariant ring of the torus action is the 
degree part, which is ©aGN^-Ra ®k 'S'a- The proof is complete once we show that 

(1) K[2;]/(/X^ J) ^©a6N^i?a«)K5'a, 

since then the spectra must be the same. The toric fiber product / x_4 J is the kernel of 
the ring homomorphism 

thus the first isomorphism theorem asserts K[2;]/(/ x_4 J) = im0. Since deg(x*) = 
deg{yl) = SLi, im0 is a subalgebra of ©aeN^i-Ra ©k ^a- We need to show that surjects 
onto it. As algebras, R is generated by ©ae^^i-Ra and 5* is generated by ©ae^^i'S'a- Now let 
© y'^ be a monomial in some Ra ©k •S'a. Since A = {ai, . . . , a„} is linearly independent, 
there is a unique way to write a = Yl^=i -^i^i with Aj G N. Thus 

Al Xn Al Xn 

r=l r=l r=l r=l 

So we have 

Al X„ 

© = n 4. ® vL ■ ■ ■ n ^l. ® ylr 

r=l r=l 

and this monomial is in the subring generated by (BaeARa ©k ^a. Since the monomials 
span the entire ring ©asN^-Ra ©k 5'a as a vector space, every element in ©asN^^-Ra ©k •S'a is 
in im0 = K[2;]/(J x_4 J), which completes the proof. □ 

The assumption of linear independence is essential for the proof of Proposition 2.2 and 
the statement is no longer true if A is linearly dependent. We always have 

(Spec iK[x]/I) X Spec (K[|/]/J)) / /T = Spec ( i?a ©k Sa) 

aeNA 

but (1) fails. Indeed, K[z]/ (/ x_4 J) is a strict subset of ©aeN^-Ra ©k •S'a when A is linearly 
dependent. While not, in general, a toric fiber product, this ring and the associated GIT 
quotient do arise in algebraic geometry, in particular in the work of Buczynska [3] and 
Manon [22]. Because of its appearance in other contexts, we feel that this object is worthy 
of its own definition. 

Definition 2.3. Let R and 5* be two rings graded by a common semigroup NA. The 

multigraded Segre product is 

R XNA S = ©aeN^-Ra ©K 'S'a. 

With this new definition. Proposition 2.2 is equivalent to the statement: 
Proposition 2.4. If A is linearly independent, then 

K[x]/I KM/J = K[^]/(/ x^ J). 
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2.2. Persistence of normality. One of the most basic questions about an ideal J in a 
ring R is whether or not the quotient R/I is normal. When / is a toric ideal, K[x]// is 
an afRne semigroup ring and normality can be characterized in terms of the semigroup 
having no holes. In algebraic statistics, normality implies favorable properties of sampling 
algorithms for contingency tables [4, 34]. In this section we show that normality persists 
under codimension zero toric fiber products. We only treat the case of (not necessarily toric) 
prime ideals, which suffices in many situations (see for instance [33, Proposition 2.1.16]). 

Theorem 2.5. Let I and J he homogeneous prime NA-graded ideals, with A linearly 
independent, and suppose that ]K[x]// and K[?/]/J are normal domains (that is, integrally 
closed in their field of fractions). //K is algebraically closed, then ^[z]/{I x_4 J) is normal. 

The assumption that K is algebraically closed is needed to ensure that ]K[2;]/(/ x_4 J) is 
a domain. This holds more generally if / and J are geometrically prime (see Theorem 3.1). 
If this is given, the field assumption can be weakened to IK being a perfect field, that is a 
field K such that either char(K) = or char(K) = p and K = {a^ : a G K}. The proof of 
Theorem 2.5 is based on the following observation which is easy and independent of the 
codimension of A. 

Lemma 2.6. The multigraded Segre product is a direct summand of the tensor product 
-R ®K "S* (as a module over the subring). 

Proof The inclusion 0a6N^ ®k Sa ®aeNA ®beNA ®k Sb splits via the 
(©aGN^ ®K 5'a)-module homomorphism that maps yl to itself if a^ = a; and zero 
otherwise. □ 

We anticipate that Lemma 2.6 will be useful in relating properties of multigraded Segre 
products to those of the factors. For instance, a careful analysis of the Castelnuovo- 
Mumford regularity would be interesting, but is beyond the scope of this paper. We 
apply the lemma to prove persistence of normality in codimension zero. Note that the 
codimension requirement enters because only if A is linearly independent. Lemma 2.6 
gives us a handle on the toric fiber product. 

Proof of Theorem 2.5. Let R = K[x]/I and S = K[y]/ J. It is easy to see directly (and 
also follows from Theorem 3.1 below) that ]K[z]/(/ x_4 J) is a domain, given that IK is 
algebraically closed. An algebraically closed field is perfect and therefore, if R and S are 
normal, then R (8>k S is normal. This follows from Serre's criterion and [36, Theorem 6]. 
Since a direct summand of a normal domain is normal. Lemma 2.6 completes the proof. □ 

The main case of interest for our applications is when the ideals / and J are toric 
ideals and various special cases have been proved in the algebraic statistics literature. 
For example, Ohsugi [25] proves this for cut ideals, SuUivant [31] for hierarchical models, 
and Michalek [23] for group-based phylogenetic models. The proofs of these results 
are essentially the same, and consists of analyzing a toric fiber product of the grading 
semigroup. We introduce this setting now. 

2.3. Fiber products of vector configurations. If / and J are toric ideals, then I Xj^^J 
is also a toric ideal. The corresponding vector configuration arises from taking the fiber 
product of the two vector configurations corresponding to / and J. Let B = {b* : i G 
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[r],j G [si]} C Z'*! and C = {c^ : i E [r],k E [ti]} C Z'^^ be two vector configurations. 
As necessary, we consider B and C as collections of vectors or as matrices. Tliese vector 
configurations define toric ideals C K[x] and Ic C K[y] by 

= (s" -x^ ■.Bu = Bw) and Jc = (y" - : Cu = Cv) . 

To say tliat Iq and Jc are liomogeneous witli respect to tlie grading by A witli deg(x*) = 
deg(?/^) = a' is to say that tliere are linear maps tti : l/^ — )■ If and 1x2 ■ 1^'^^ such that 

7ri(b*) = a* for all i and j and vr2(c^) = a* for all i and fc. The new vector configuration 
that arises in this case is the fiber product of the vector configurations. 

Bx^C = {(b;,4) G Z^^+'^^ : t G [r],j G N, A; G [t,]}. 

The notation is set up so that the toric fiber product Jg is the toric ideal 

Ib^aIc = Ibx^c = {z^-z- -.{Bxj, C)u ={Bx^ C)v) . 

Indeed, if K[s] and K[t] are polynomial rings, and 

0:K[x]^K[s] 

are K-algebra homomorphisms, then we can form the toric fiber product homomorphism 

If / = ker (f), J = ker and both ideals are homogeneous with respect to the grading by A, 
then I x^J = ker(0 x^^ip). In the toric case, when 0, are monomial homomorphisms, 
it is easy to see that i3 x_4 C defines the toric fiber product homomorphism. 

In most cases our interest is in the ideal Ib ^a^c = ^BxaC and not the specific vector 
configuration. A useful technique is to modify the vector configuration x_4 C to any 
other set of vectors with the same kernel, without changing the toric ideal. For example, 
we could also use the vector configuration 

Bx^C = {(b},a\4) G Z'^^+'=+'^^ : t G [r],j G [s,],ke [U]}. 

3. Persistence of primary decomposition 

Primary decompositions of toric fiber products consist of toric fiber products of primary 
components. This property is most useful when the generating sets of the components are 
explicit, such as in the codimension zero case. To state the result, recall that an ideal is 
geometrically primary if it is primary over any algebraic extension of the coefficient field. 

Theorem 3.1. Let I C K[x] and J C K.[y] be A-homogeneous ideals. Let / = Ji fl ■ ■ • fl 
and J = Ji n ■ ■ ■ n J/ be primary decompositions of I and J such that all ideals li and Jj 
are homogeneous with respect to A. Then 

(2) iy<AJ = nti n;.=i /, x^ j,-. 

//, in addition, the ideals li and Jj are all geometrically primary, then (2) is a primary 
decomposition of I x^J . 
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Proof. First we show that the decomposition is vahd. This follows if we show that for all 
NA homogeneous ideals Ji, /2 G K[x] and J G K[?/], 

(Ji n h) J = (Ji J) n ih J). 

Let : K[2;] — K[x] ®k 1K[?/] be the K-algebra homomorphism such that zj^ (-> a;* ® y^. 
A polynomial / belongs to a toric fiber product / x^^ J if and only if 0(/) G / + J C 
K[x] ®K = K[x, y]. Thus 

/G(/in/2)x^j ^ e (/^ n /2) + J 

^ G (Ji + J) n (/2 + J) 
^ /G(/ix^j)n(/2x^j), 

where the second equivalence is because /j and J are ideals in disjoint sets of variables. 

For the second claim, since li Jj is the inverse image of Jj + Jj, and inverse images 
of primary ideals are primary, it suffices to show that for any geometrically primary ideals 
/ C ]K[a;] and J C K[?/], that / + J C K[x, is geometrically primary. First, note that the 
statement clearly holds if / and J are geometrically prime ideals, since the join of two 
irreducible varieties is irreducible. The proof of Proposition 1.2 (iv) in [28] contains the 
cases of geometrically primary ideals. □ 

Theorem 3.2. Suppose that A is linearly independent. Then the decomposition 

(3) /x^ J = nt,n5=i/, x^ J, 

is irredundant if and only if for all ii,i2 G [k] and ji,j2 G [/] with ii ^ ^2 or ji ^ j2 either: 

• there exists a G NA such that (/jja ^ (-^j2)a md (^,2)3 7^ lK[?/]a, or 

• there exists b G NA such that (Jjjb 2 (<^i2)b (ind (/i2)b 7^ lK[a;]b- 

Proof. To deal with irredundancy of the decomposition, we must describe conditions 
on I,K C K[x] and J, L C K[y] that imply / x^ J C fsT x^ L. Let = K[x]/I, 
S = K[y]/J, R' = K[x]/K, and 5" = K[y]/L. Since A is Unearly independent, the rings 
x_4 J) and K[z]/{K x_4 L) are multigraded Segre products. So / x^ J <Z K x^ L 
if and only if R' Xj^^ 5" is a quotient of i? Xi^_4 5* by the ideal generated by the image 
of i^' x^ L in i? Xp^^ 5. On the level of the homogeneous components, we require that 
R'a ®K S'g^ = Ra ®K S^/ {K x_4 L)a, as K-vector spaces. There are two ways that R'^ ®k S'^ 
could be a quotient of i?a ®k S^- If /a ^ and Ja ^ -^a; then (/ x_4 J)a C (^K x_4 L)a, 
in which case we have the desired quotient. The second way is if the tensor product 
R'a ®K S'g^ = {0}, which happens if and only if either or S'^ is {0}. On the level of ideals, 
this happens if and only if either = IK[x]a or = ^[y]a- 

The decomposition (3) is redundant if and only if there are ii,i2 and ji,j2 where 
lii x^ Jj-^ ^ Ii2 J 32 (where one of ii = 12 and ji = j2 is allowed, but not both). Now 
^aJji ^ h.2 ^A'Jj2 if s-^d o^ly if ^ ^ ^-^j (K[x]/Jj2)a®K (lK[?/]/Jj2)a is a quotient 

of (K[x]//jja ®K Jjja- This happens if and only if for each a G NA the condition 

in the previous paragraph is satisfied. Thus, Jj^ x_4 J^j Ii2 Xa J 32 if only if the 
negation of this condition holds. Choosing a from the first condition of the theorem with 
respect to j = j2, yields the desired non-containment in the case ii ^12- If i\ = ^2 and 
ji 7^ J2, we choose b from the second condition of the theorem with respect to i = ii. This 
proves the sufficiency of the conditions. 
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The two conditions are necessary since the first is necessary for Jj^ xa Jj 2 Jjj 
while the second is necessary for /« Jjj li Xa Jj2- D 

Corollary 3.3. Let A be linearly independent. Suppose that I = Ji fl • ■ • fl and 

J = Ji n ■ • • n J; are A homogeneous irredundant primary decompositions of I and J 
into geometrically primary ideals, and that for each i E [k], j E [I], and a G NA, neither 
(/i)a = K[x]a nor (Jj)^ = K[y]a. Then 

is an irredundant primary decomposition of I x^J . 

Proof. We combine Theorems 3.1 and 3.2. Since the ideals and Jj are all geometrically 
primary, the decomposition of / x_4 J is a primary decomposition. Since the decomposition 
of / is irredundant, for each ii 7^ 12 there exists a a G 'RA such that (/jja 2 (-^12 )a and, 
by assumption, for all j ( Jj)a 7^ lK[?/]a. Similarly, the decomposition of J is irredundant, 
for each ji ^ j2 there exists a b G 'RA such that ( Jjjb 2 (-^i2)b and, by assumption, for 
all i, (/i)b 7^ lK[?/]b. This implies that the decomposition is irredundant. □ 

To apply Corollary 3.3 iteratively, we need to control when its hyptheses are preserved. 

Lemma 3.4. Let A he linearly independent, and let B induce a grading on K[x] such that 

• for all heNB (/)b ^ ^[x]^, and 

• for all aeNA (J)a ^ K[y]a. 

In this case (/ x_4 J)b 7^ K[z]b for all h G NB. 

Proof. Let R = K[x]/I and S = K[y]/J. We decompose the ^-graded parts of R into 
their ;B-graded parts. The conclusion is equivalent to the statement that in 

^ -R{a,b) ®K 5'a, 
(a,b)eN(^,B) 

for each b G NB there is an a G NA such that -R(a,b) ®k •S'a 7^ 0. Since (/)b 7^ IK[a;]b, for 
each b there exists an a such that R{a,b) 7^ 0. Now the statement holds since 5'a 7^ 0. □ 

Example 3.5 (Monomial primary decomposition). For monomial ideals /, J C K[x] = 
K[xi, . . . , Xn] with the fine grading on K[x], we have I Xj^^ J = I + J. This formula and (2) 
yield a highly redundant formula for the irreducible decomposition of a monomial ideal: 

ji,...,>e[n] 

For an explicit example consider: 

{x^y,xy^) = (x^y) x^ (xy^) = {{x^) n (y)) x^ {{x) n (y^)) = 

{x\x) n {x\y^) n {x,y) n {y,y^) = (x) n {x^,y^) n {y). 

Redundancy arises in the decomposition as this toric fiber product does not satisfy the 
conditions of Theorem 3.2, with respect to the two pairs of ideals (x) , (y) and (y^), {x"^)- 
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Finally, the decomposition can be redundant even when the ideals are radical, as the 
following calculation illustrates: 

{xy.xz) = {xy) {xz) = ((x) n {y)) ((x) n {z)) = 

(x, x) n (x, z) n {y, x) n (y, z) = (x) n (y, z). 

4. Generators of toric fiber products of toric ideals 

To each higher codimension toric fiber product there is a natural codimension zero 
product (Definition 4.1) which contributes many of the generators. There are also additional 
generators glued from certain pairs of generators of the original ideals. Keeping track of 
the different contributions requires substantial notation which we found managable only 
in the case of toric ideals. To verify our results we require that the generating sets of the 
original ideals satisfy the compatible projection property (Definition 4.7). Any generating 
set can be extended to one that satisfies this property, but it may be inscrutable how to 
do so. In special cases, however, the condition becomes clear. For instance, in codimension 
one toric fiber products the simpler slow-varying condition (Definition 4.10) implies the 
compatible projection property. 

Let / x_4 J be any toric fiber product. Define the ideal / by 

/ = (/(X) + (x} - X;<f : « e [r], J G [s,])) H K[x] 

and define J C K[|/] in a similar way. Here I{X) denotes the ideal obtained by replacing 
all occurrences of x* with Xj. Let A = {ci, . . . , Cr} be the standard unit vectors in N''. 
By construction, / and J are homogeneous with respect to the grading induced by 
deg(x*) = deg{yl) = Ci. By construction / is the subideal of / generated by all A- 
homogeneous elements. Hence I ^ I and similarly J G J. 

Definition 4.1. The ideal / x_^ J is the associated codimension zero toric fiber product 
to / x_4 J. 

In this section, I = Is and J = Jq are toric ideals. As in Section 2.3, we describe 
their toric fiber product and its associated codimension zero product by their vector 
configurations. Consider the linearly independent vector configuration A = {(a*,ej) : i G 
[r]}, where Cj is the i-th basis vector of Z*". Define vector configurations 

i3 = {(b},e,) : i e [r],j G [si]} and C = {{cl, a) : i e [r], k e [ti]}. 
Then Ii^ = 1^, Jc = Jq, and 

To describe generators of the toric ideal Ibx^c, we first relate them to Markov bases, 
via the fundamental theorem [6]. Let A G Z'^^" be a matrix, which defines a toric ideal 
I A = (p" — p^ '■ Au = A\) C K[pi, . . . ,Pn]- Hence, binomial generators of I a correspond 
to elements in ker A. The matrix A defines an N-linear map — i- Z"^ whose image is the 
affine semigroup NA. Let b G NA. The fiber of b is the set A'^[h] := {u G : = b}. 
Let J-" C ker A. For each b G NA we associate a graph 74~^[b]jr, with vertex set consisting 
of all lattice points in A^^[b] and an edge between u, v G A~^[b] if either u — v or 
V — u G J-". A finite subset J-" C ker A is a Markov basis of A if the graph A^^fbjj- is 
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connected for each b G NA. The fundamental theorem of Markov bases connects these 
lattice based definitions with the generators of the toric ideal Ia- 

Theorem 4.2 (Fundamental Theorem of Markov Bases [6]). A finite subset T C ker A is 
a Markov basis of A if and only if the set of binomials {p^^ — : f e J-'} generates Ia- 

The fundamental theorem implies that we can describe generating sets of toric ideals, 
and especially important for us, toric fiber products of toric ideals, in terms of lattice 
point combinatorics. We use tableau notation for binomials and vectors. To explain it, let 

™il ™j2 . . . ™in _ i'l i'2 . . . i'n 

Jl 32 Jn Ji J2 J„ 

be a homogeneous binomial in K[x]. To this binomial we associate the tableau of indices: 





Jl 




-A 


Ji - 




32 






f2 




Jn . 




J'n 


Jn - 



Similarly, we can define the tableau associated to binomials in and which might 
look like 





ki 1 




\A 


k[ - 




" ii 


Jl 


ki 1 






J[ 


k[ 




k2 




i'2 


^2 


and 


12 


J2 


k2 




i'2 


j'2 


^2 






















. ^n 






-i'n 


K. 






Jn 






.i'n 


j'n 


y 



respectively. Tableau notation greatly simplifies the description of Markov bases of toric 
fiber products. 

4.1. Codimension zero toric fiber products. We review the codimension zero case 
from [32] since generators of the associated codimension zero toric fiber product are needed 
in our construction. Let / e be a binomial written in tableau notation as 



" ii 


Jl " 




r^'i 


J'l 1 


i2 


J2 




i'2 


j'2 


_ 


Jn . 




.i'n 


Jn - 



Since A is linearly independent, if / G Ib, then the multiset of indices {ii, . . . i„} equals 
the multiset of indices {i'l, . . . i'^}. So after rearranging the rows of the tableau, we can 
assume that we have the following form: 



" ii 


Jl " 




" ii 


j'l] 


i2 


J2 




i2 


j'2 


_ I'n 


Jn . 




. I'n 


Jn - 
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Let ki, . . . ,kn be a collection of indices such that is a variable in K[z] for each t. 
Construct the new polynomial 



/ 



i2 



Ji 

32 
3n 



ki 
k2 

kn. 



12 



3'i 

3'2 



ki 
k2 



*n jn J 



i 31 


ki ' 




i 31 


k2 ' 


. ^ 32 


k2 




. ^ ^2 


k, _ 



For a set of binomials T Q Is let Lift(J^) to be the set of all binomials / for all / e and 
allowable ki, . . . ,kn- Similarly, for a collection of binomials ^ C J^, we can define Lift(^). 
Lastly, we introduce a set Quad which consists of all binomial quadrics of the form 

/ 

Theorem 4.3 (Codimension zero toric fiber products, [32]). Let C K.[x] and Jq C K[i/] 
he homogeneous with respect to the grading by A, and suppose that A is linearly independent. 
Let J-^ Q Ijs and G Q Jc be binomial generating sets. Then 

Lift(J^) U Uh{g) U Quad 

is a generating set of the codimension zero toric fiber product Xj\^ Jc. 

4.2. The compatible projection property. Suppose that f & Ib and g & Jc are two 
binomials of degree n, written in tableau notation as 





«1 


3i 




-A 


3[ - 






" ii 


h - 




\^'l 


k[ - 




i2 


32 




^2 


3'2 


and 




i2 


k2 




^'2 


^2 










9 = 
















3n . 




J'n 


3n - 












J'n 


k' 



In particular assume that the first column of the leading and trailing monomial of / agrees 
with the first column of the leading and trailing monomial of g, respectively. In this 
situation, we define glue(/, g) to be the binomial 

ki 
k2 



glue(/, g) 



12 



31 

32 



3n 



k 



Ji 

3'2 



k[ 



ki 



and (t)yw by 



Let IK['u;] := IK['u;^, . . . , w"^], and define K-algebra homomorphisms 

(f)xw '■ ^[x] X* 1-^ w\ 

(py^ : K[y] K[w] yl ^ w\ 
In general, we define the gluing operation on pairs of binomials f E Ib and g ^ Jc such 



that (j)r,yj{f) 



and (j)yy,{g) 



w^^). The binomial part in both 



products are assumed to be the same, and we say that / and g are compatible. Furthermore, 
we can assume that gcd{w^^,w^^) = 1, by not factoring the polynomials completely. 

Define L{w^'^) to be the set of all monomials in K[x] such that (f)xw{x^) = w^^. 
Similarly, define R{w^^) to be the set of monomials y^ in K.[y] such that (pyw{y^) — w^^- 
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By construction if G L{w^'^) and y^' E R{w'^'^) then x"^ f and y^' g, when written as 
tableau and after reordering rows, have exactly the same first column. Thus, we can form 
the binomial glue(a;"^/, y^ g). 

Definition 4.4. Let ^ Ib and Q C Jq consist of binomials. The glued binomials are 
Glue(J^,^) = {g\ue{x^ f,y^'g) : f eJ^^geQ compatible, x^ G L{w^^),y''' G R{w^^)}. 
Proposition 4.5. If J- Q Ib (ind Q Je are sets of binomials then 

G\ue{J^,g)clB^^c- 

Proof. For toric ideals, a binomial /i G K[z] belongs to IbxaC if ^^d only if (t>zx{h) G Ib 
and 4>zy{h) G Ic, where 4>zx and (p^y are the K-algebra homomorphisms 

(f)zx •■ Hz] ^ K[x], 4fe^4' 
(l)zy:K[z]^K[y], z^k ^ yl 

For any glue(x''/, y'^'g) where / G Ib and g G Jc, we have 02^(glue(x''/, y""' g)) = x^'f G Ib, 
and (/)22^(glue(x^/, y^'^)) = y""' g G Jc- □ 

Consider the natural N-hnear projection maps 7 : N^^-^*^ — >■ N'', 7(6^-^.) = e,, 71 : — >■ 
N'',7i(e*) = ej, and 72 : N'' — )■ N'',72(e^,) = Cj. These projections evaluate the additional 
multidcgrees appearing in the definition of the associated codimcnsion zero product. They 
are also defined on the fibers i3~^[b] and C~^[c] and the graphs i3~^[b]^ and C^^[c]g. Note 
that if f G kerB then 71(f) G ker.4, and similarly for 7, and 72. 

Definition 4.6. Let J-" C keri3. The graph 7i(i3~^[b]^) has vertex set 7i(i3~^[b]) and an 
edge between u' and v' if there are u, v G 'B~^[b] such that u and v are connected by an 
edge in i3^^[b]jr and 7i(u) = u' and 7i(v) = v'. Similarly define the graphs 72(^^~^[c]0) 
and 7((-B x^C)~^[(b, c)]^^) where G C kerC and H C kerB x^C. These are the projection 
graphs. 

Given two graphs G and H with overlapping vertex sets, their intersection G H H is the 
graph with vertex set V{G) H V{H) and edge set E{G) fl E{H). 

Definition 4.7. Let J-" C keri5 and Q C kerC The pair J-" and Q has the compatible 
projection property if for all b G NB and c G NC such that 7ri(b) = 7r2(c), the graph 

7i(^-^[b]^)n72(C-^[c]0) 

is connected. 

The next lemma is the main technical result allowing us to produce generating sets for 
toric fiber products. 

Lemma 4.8. Let T C kerB and Q C kerC. Let b G WB and c G NC such that 
7ri(b) = 7r2(c). Then 

^{{B x^C)-^[(b,c)]Giue(^,e)) = 7i(^-'[bW n72(C-Mc]0). 

Proof. We must show: 

(1) V-(7((Bx^C)-M(b,c)]Giuera)) = V{^,{B-\h]^))nV{^,{C-'[c]g)), 
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(2) i?(7((S x^C)-M(b,c)]Giuc(^,g))) = i?(7i(^-Mb]^)) ni?(72(C-Mc]g)). 
In both part (1) and (2) the containment "C" is straightforward, by projecting. Indeed, if 
u G (i3 x_4C)^-'^[(b, c)], then applying the canonical map n^x '■ ^^^^ lP gives t^zx{^ ^ 
B~-'^[b] and 7(u) = ^\{j^zx^\ Similarly, 7(u) = 72(7r2j^(u)). Furthermore, if u and u' and 
connected by an edge corresponding to the binomial glue(a;"^/, i/"^ gi) G Glue(J-', ^) then 
7r2;a;(u) and Tx^xk^) are connected by f, and 'Kzyivi) and 7r2j^(u') are connected by g, where 
f = — and g = — . 

Proof of part (1). We must show that if d is in both 7i(i3"^[b]_7r) and 72(C~^[c]g) 
then d G C)~^[(b, c)]Giue(j^,g)])- By assumption there are Ui G B~-'^[b] and 

U2 G C~^[c] such that 7i(ui) = 72(u2) = d. Since 7ri(b) = 7r2(c) and 7i(ui) = 72(u2) 
the corresponding monomials x^^ and y^"^ have the same A degree. Since A is linearly 
independent, the monomial x^^y^'^ G K[a;] is in the image of <pi^.jg- Let be a 

monomial such that {B x_^C)u = (b,c, d) and hence {B Xj\^C)u = (b,c). But this implies 
dG7((i3x^C)-H(b,c)]Giue(^,e)]). 

Proof of peirt (2). Suppose that d and e are both in 7i(S ^[b]j^) and 72(C ^[c]g), 
and they are connected by an edge. We must show that d and e are connected by an 
edge in 7((i3 x_4 C)~^[(b, c)]Giuc(j',g)])- To do this, we must show that there are wi and 
W2 G {B x_4 C)~^[(b, c)], with 7(wi) = d and 7(w2) = e such that wi — W2 G Glue(J-', ^). 

Since there is an edge in 7i(H~^[b]:F) between d and e, there exist Ui and U2 in B~-'^[b] 
such that 7i(ui) = d, 7i(u2) = e and Ui — U2 = f G J^. Similarly, there are vi and 
V2 G C^^[c] such that 72(vi) = d, 72(v2) = e and Vi — V2 = g G ^. By part (1), there 
exists wi G {B x_4 C)"^[(b, c)] which projects to (ui,vi) and W2 G {B x_4 C)~^[(b, c)] 
which projects to (u2, V2). There are many choices for Wi and W2. We claim that we can 
choose them so that Wi — W2 G Glue(J^, Q), which completes the proof. 

To prove the claim, we explicitly construct these elements. This requires an under- 
standing of the precise forms that Ui, U2, Vi, and V2 take. Writing Ui — U2 and Vi — V2 as 
tableaux in block form we have: 







\h 








J'l] 


Ui - U2 = 






J2 




h 


J'2 






[h 


A 






M 




'h 






'I'l 




Vi - V2 = 


1*2 


K2 




1*2 














K3 



The first two blocks of rows in the tableaux for Ui — U2 give the support of this difference. 
This corresponds to the binomial /. The last block of rows corresponds to the part where 
the vectors agree, and hence is the same in both Ui and U2. Similarly, the first two blocks 
of rows in the tableaux for Vi — V2 give the support of this difference. This corresponds to 
the binomial g. The last block of rows corresponds to the part where the vectors agree, 
and hence is the same in both Vi and V2. 

The first block of rows in both ui — U2 and vi — V2, have the same Ji and /( because 
these blocks correspond to the common binomial (w^^ — w^^) in (pxwif) — w^^{w^^ — w^^) 



and 



Si 



Note that this corresponds to d — e. This implies that in 



the second and third blocks of rows of Ui and of U2 we have exactly the same multisets 



MULTIGRADED COMMUTATIVE ALGEBRA OF GRAPH DECOMPOSITIONS 



15 



of indices in the first column. This explains why I2 and J3 appear in both the Ui and U2 
tableaux. A similar argument, yields that J| and should appear in both vi and V2. 
Finally, we must have that the multiset of indices appear in I2 and together equals 
the multiset of indices that appear in I2 and 13 together. By our usual assumption that 
gcd(w'"^, ^""2) = 1, we see that the multisets I2 and are disjoint. This implies that, as 
multisets, I2 C /* and I2 h ■ 

With all this information on the structure of the tableau, we can build our element of 
Glue(J-', ^). Indeed, we construct this binomial by constructing its tableau form, which is: 





7i 


Ji 








J[ 




h = 


h 


J2 


M 




h 


J'2 


M 




1*2 


N 


K2 




I2 


N 


K'2 



Here M is chosen so that the rows of [I2 M] are a multi-subset of the rows of [/| K^], 
and is chosen so that the rows of [I2 N] are a multi-subset of the rows of [I3 J3] . By 
construction h G Glue(J-', ^) since the x monomial corresponding to [I2 N] belongs to 
L{w'^^) and the y monomial corresponding to [I2 M] belongs to R{w'^^). 

We do not yet have wi and W2, since there might be leftover indices from the last blocks 
of rows of Ui — U2 and Ui — U2. Call these remaining rows: [/ J] — [I J] in the first case, 
and [/ K] — [I K] in the second. Note that we have the same multiset of indices / in 
both, since we have extracted I2 and I2 from both the pair I2 and J3 and the pair and 
/g, which had the same multiset of indices. This means, finally, that we have wi and W2 
in tableau notation as: 



\h 


Jl 












h 


J2 


M 




h 


J'2 


M 


I2 


N 


K2 




1*2 


N 


K'2 


I 


J 


K 




I 


J 


K 



Since T^zxiyfi) = ui and i^zyiy^i) = vi, this implies 7(wi) = d. Similarly, 7(w2) = e. 
Finally, by construction wi and W2 are connected by the move /i, which is in Glue(J-', Q). 
This completes the proof since now 

E(7(i3 x^C-^[(b,c)]Giue{.F,g)])) ^ E{^,{B-'[h]^))r}E{^2{C'^[c]g)). □ 

The idea of the proof of Theorem 4.9 is summarized by Figure 2. We wish to show 
that the graph of each fiber is connected. To do so we decompose the lattice ker S C 
into two directions. The first direction (vertical in the figure) corresponds to the lattice 
of the associated codimension zero toric fiber product. The subgraphs of fiber elements 
constrained to lie in a translate of that lattice are connected since we have a Markov basis 
for the associated zero toric fiber product. The remaining lattice directions (essentially 
horizontal in the figure) arise because the product is not actually of codimension zero. By 
projecting via 7 and showing that the image graph is connected (using Lemma 4.8), we 
deduce that the entire graph is connected. 

Theorem 4.9. Let l-i C ker i5 x_^C he a Markov basis for the associated codimension zero 
toric fiber product. Let T C ker i3 and Q C kerC Then H, U Glue(J-', Q) is a Markov basis 
for B x_4 C if and only if and Q have the compatible projection property. 
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Figure 2. Illustration of connected fibers. 

Proof. We must show that for any (b, c) G N{Bx_/(C) the graph {Bxj(C)^^[{h, c)]^uGiue(j^,g;) 
is connected. For each d G NV consider the subgraph of {B x_4 C)^^[(b, c)]^uGiue(j^,e) 
whose vertices consist of all (u, v) G {B x_4 C)^^[(b, c)] such that 7i(u) = 72(v) = d. 
This is precisely the set B C~^[(b, c, d)]. This subgraph is connected since "H is a 
Markov basis for B C. The graph 7((i5 x^ C)~^[(b, c)]^uGiue(j",g)) equals the graph 
x_4 C)~^[(b, c)]Giue(j",g)) because T-L is contained in the kernel of the projection 7. 
This graph is connected since J-" and Q have the compatible projection property and by 
Lemma 4.8. But if the image of a map of graphs is connected and each fiber is connected, 
then the graph itself is connected, which completes the proof of the if direction. 

Conversely, if every fiber is connected, the graph (i3x^C)~^ [(b, c)]-^uGiue(:F,g;) is connected, 
so the graph 7((i3 x^ C)~^[(b, c)]Giue{j',g)) is connected. By Lemma 4.8, this equals 
7i(i3~^[b]jr) n 72(C~^[c]g) so that J-" and Q have the compatible projection property. □ 

Theorem 4.9 gives an explicit way to construct a Markov basis for B x^C. However, 
there remains a serious difficulty in finding sets J-" C ker B and Q C ker C which have the 
compatible projection property. In general, it is not true that J-' and Q can be arbitrary 
Markov bases of B and C. 

4.3. Slow-varying Markov bases. In the remainder of the section, we describe the 
slow-varying condition (generalizing [10]) which, if the codimension is one, can be used to 
show that a given pair of Markov bases satisfies the compatible projection property. 

Definition 4.10. Suppose that i3 x_4 C is a codimension one toric fiber product. Let 
h G Z'' be non-zero. Let J-" C keiB and Q C kerC Then J-" and Q are slow-varying with 
respect to h if for all f G J-", 7i(f) = 0, or ±h; and for all g G ^, 72(g) = or ±h. 

Proposition 4.11. Let h generate ker^. // the maximum 1-norm of any element in T 
or Q is less than 2||h||i, then T and Q are slow-varying with respect to h. 

Proof. Since 71(f) must be a multiple of h and ||7i(f)||i < ||f||i , if ||f||i < 2||h||i then 
7i(f) is either or ±h. A similar statement holds for 72(g). □ 
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Theorem 4.12. Suppose that B x^C is a codiniension one toric fiber product. Let 1-i he a 
Markov basis for B x^C. Let T and Q he Markov hases for B and C that are slow-varying 
with respect io h G ker ^. Then 1-i U Glue(J-', Q) is a Markov basis for B Xj^C. 

Proof. Since the toric fiber product is codiniension one, the vertex sets of the graphs 
7i(i3~^[b] jp) and 72(C^^[c]g) are subsets of the lattice Zh. Since J-' and Q are Markov 
bases, these graphs are connected. By the slow-varying condition, the edges connect two 
points whose difference is ±h. Hence the graphs 7i(i3~^[b]jr) and 'y2{C~^[c]g) are intervals 
of ordered points. The intersection of two such graphs is another graph of the same 
type, and is also connected. Thus J-' and Q have the compatible projection property and 
Theorem 4.9 then implies that H U Glue(J-', Q) is a Markov basis for B xj^C. □ 

In general, we cannot expect to simply use minimal Markov bases J-" and Q of B and C 
to construct a Markov basis of i3 x_4 C. Indeed, even in the codimension one case when 
those Markov bases are not slow-varying, we might have the situation that every / G J-" 
satisfies 7i(/) = 0, ±h, ±2h and every g E Q satisfies 72(5') = 0, ±h, ±2h, but there are 
elements h in the Markov basis for B xj^C, with 7(/i) = mh for m large. The problem 
is illustrated by Figure 3, which would require augmenting the sets J-' and Q with some 
elements that had 7i(/) = 72(5') = ±3h to guarantee the compatible projections property. 

© — © — © n ® — CD — © 
= © © 

Figure 3. A codimension one toric fiber product that is not slow- varying. 

5. Application: Markov bases for hierarchical models 

Let r be a simplicial complex with vertex set V, and let d G Zi>2 a vector of integers. 
These data define a hierarchical model as in Section 1.1, and hence a toric ideal /r,d- For 
any homogeneous ideal /, let denote the largest degree of a minimal generator of 
/, which is an invariant of the ideal. This is a coarse measure of the complexity of the 
ideal /. If F is a graph and (i„ = 2 for all v G V, /i(/r,d), it is an invariant of F dubbed 
the Markov width in [5]. We calculate /i(F, c?) := ^{I^^) for certain simplicial complexes 
F and vectors d. The results of Section 4 are also useful to explicitly construct Markov 
bases of these hierarchical models. 

The ideal /r,d is the toric ideal of a matrix A^^d with columns indexed by elements 
i G Dy. Each column is given by the formula 

Fefacet(r) Fefacet{r) 

where {ej^ : jp G Dj?} is the standard basis for Z°^. For S dV ^ let F^ denote the induced 
subcomplex on 5* (that is, F5 = {F G F : F C S}). The matrix Ayq^q induces a grading 
on /r,d by deg(pi) = {AYg4g)ig. This grading is the S-grading. 
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Proposition 5.1. Let T be a siniplicial complex with T = riUr2, where the vertex set ofVi 
andV2 areVi andV2, respectively. Let S = VinV2 and suppose that TinT 2 = {^1)3 = (r2)5- 
Then 

Ir,d = h^,dv^ ^^rg.dg -^ra.dva- 

Proof. Since all the ideals are toric, it suffices to show that the fiber product of the vector 
configurations Ay^4^_^, A^^^Vi equals A^^. For i G let hi^^ be the column of Ar^^y^ 
indexed by iy^. Similarly, define Ci^^, and a^^ as the appropriate columns of Ar2,(iv2 
A^g^dsi respectively. For / = 1,2, let tt; : M^^i — )■ j^g ^j^g linear projections induced 
by the grading that gives degpj^^ = degpj^^ = aj^. The toric fiber product of vector 
configurations is 

^ri.dv-i ^Ars,d5 ^r2,dv2 = {(bj,Cfc : j G rfy^. A; e dy^.js = ks}. 
This means that columns of the toric fiber product vector configuration have the form 




If a facet F appears in both Fi and F2, we can delete one of the corresponding collections 
of rows of ^ri,dvi ^^r^ ds ^r2,dv2' without changing the kernel of the matrix, and hence 
the toric ideal. After eliminating repeats, we precisely have the matrix of A^^d- D 

In [15], the codimension of a hierarchical model (F,(i) is given by the formula 

(4) En(^^-i)- 

Hence, the toric fiber product from Proposition 5.1 is a codimension zero toric fiber 
product if and only if F5 = 2'^, and is a codimension one toric fiber product if and only if 
Ts = 2^\ {S} and d, = 2 for aU s G S. 

Proposition 5.2. Let T he a simplicial complex with F = Fi U F2, where the vertex set of 
Fi and F2 are Vi and V2, respectively, and Fi fl F2 = (Fi)^ = (F2)s'. Let F = F U 2["^1, and 
similarly fi = Fi U 2[^] and f2 = F2 U 2[^] . Then 

Iv,d = Ir,d = hi,dv-, ^^2lS],ds ^^2,dv2- 

Proof. It suffices to show that for Jr,d, the construction of /r,d gives /f ^. Since /r,d is the 
kernel of a ring homomorphism, the construction of 

Ir,d = (I-yAP) + {Pi - P^(1^S ■ i ^ d)) f] K[p] 

simply modifies that parametrization by taking (f)(j>i) = (p{pi)qig- Thus, we have that 
/r,(i = ker (p where 

4>ipi)=iis n ^t- 

Fefacet(r) 

We can delete all the af^ parameters when F (1 S, since this does not change the kernel of 
the homomorphism. But then, this is precisely the parameterization associated with F. □ 
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5.1. Small examples. In this section we restrict to the binary case where = 2 for 
all V & V . To this end, let 2 be the vector whose every coordinate is a 2. We illustrate 
the constructions Quad, Lift, and Glue for small hierarchical models. Tableaux for 
binomials in hierarchical models have one column for each i & V (and as always one 
row per variable appearing in a monomial). For example, we represent the binomial 
J5111P122P212P221 - P112P121P211P222 as the tableau: 



'l 


1 


1" 




"1 


1 


2" 


1 


2 


2 




1 


2 


1 


2 


1 


2 




2 


1 


1 


2 


2 


1 




2 


2 


2 



Lemma 5.3. 

(1) Let Sv = \ {V}, be the boundary of a {^V — 1)- dimensional simplex. Then 
Isv,2 is generated by a single binomial: 

n p^- n 

iSDv:||i||ieven isDv:||i||iodd 

(2) Let T be a simplicial complex on V, let 

cone„(r) = ru {FU {v} : F eT} 

be the cone over F with apex v, and let be a (minimal) generating set of I^^- 
Then /cone4r),dv'u{.} (minimally) generated by 

cone„(J^) = {pi^j ■ ■ ■ pi^j - p.'^j ■ ■ ■ pi>^j -.Pi,--- Pi,, - Pi[ ■■■pi'^eT and j G [d^] } . 

Proof. 

(1) According to the dimension formula (4), Isv,2 is generated by a single equation. The 
proof of (4) in [15] shows that the given binomial generates the ideal. 

(2) This follows because one can rearrange the rows and columns of ^cone„(r),dyu{„} so 
that it is a block diagonal matrix with d^ diagonal blocks with the matrix A^^d along the 
diagonal. This decomposition appears in [16]. □ 

Example 5.4 (Binary four-cycle). Let C be a four-cycle with edges 12, 13, 24, 34. The cycle 
decomposes as the union of two paths with edges 12, 13 and 24, 34. With Vi = {1, 2, 3} and 
V2 = {2,3,4}, Ic\2 is the toric fiber product of and Icv^,'^- According to Lemma 5.3, 

the Markov basis of a path of length three with edges 12, 13, consists of the two elements 



'i 1 


1" 




'i 1 


2" 


i 2 


2 




i 2 


1 



ZG{1,2}. 



Similarly, the Markov basis for the path with edges 24, 34 consists of the two elements 

"1 1 /■ 
2 2 / 

These Markov bases are slow-varying with respect to the codimension one toric fiber 
product obtained by the overlap complex, which is two isolated vertices 2, 3. The vector h 



1 2 / 

2 1 / 



/G{1,2}. 
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for the complex of two isolated vertices is 



The glue operation on these Markov bases produces four moves: 

2,/e{l,2}. 



'i 1 


1 /" 




'i 1 


2 /" 


i 2 


2 / 




i 2 


1 / 



The associated codimension zero toric fiber product is the hierarchical model associated 
to the complex T = C U {{2,3}}, two triangles glued along an edge. It produces four 
quadratic elements of Quad : 



'l 


j 


k 


I 




"l 


j 


k 


2 


2 


j 


k 


2 




2 


j 


k 


1 



j,A;e{l,2}. 

A triangle with edges 12, 13, 23 has a single quartic move in its Markov basis, which is: 



'l 


1 


l" 




"l 


1 


2 


1 


2 


2 




1 


2 


1 


2 


1 


2 




2 


1 


1 


2 


2 


1 




2 


2 


2 



Lifting this move produces 16 quartic Markov basis elements: 



'l 


1 


1 


h 




'l 


1 


2 


h 


1 


2 


2 


h 




1 


2 


1 


k 


2 


1 


2 


h 




2 


1 


1 


h 


2 


2 


1 


h 




2 


2 


2 


h 



h, h, h, ^4 £ {1, 2}. 



Similarly, the lifting operation from the cycle with edges 23,24,34 produces 



ii 


1 


1 


l" 






1 


1 


2" 




1 


2 


2 






1 


2 


1 




2 


1 


2 




H 


2 


1 


1 


u 


2 


2 


1 




ii 


2 


2 


2 



«i,«2,«3,^4 e {1,2}. 



Theorem 4.12 implies that the lifts of 8 quadrics and 32 quartics generate the Ic,2- However, 
these elements do not form a minimal generating set. Direct computation in 4ti2 [1] 
shows that a minimal Markov basis contains all 8 quadrics but only 8 of the quartics. 

Similar arguments and the description of Markov bases of small cycles in Lemma 5.9 
can be used to get an explicit description of Markov bases of the four-cycles that appear 
in Example 1.2. We can also produce analogous results for higher dimensional complexes. 

Theorem 5.5. Let Bn be the simplicial complex with vertex set [n + 2] and minimal non- 
faces [n] and {n + l,n + 2}. The ideal 1 3,^,2 has a generating set consisting of binomials 
of degrees 2, 2""-'^, and 2" . 

Proof. For i = 1, 2 let Fj be the cone -B„ \ (n + i) over the boundary of the simplex on [n]. 
Then = Fi U F2. According to part (1) of Lemma 5.3 the Markov basis of /rinr2,2 
consists of a single element of degree 2"~^; and according to part (2) the ideals /ri,2 are 
each generated by two binomials of degree 2"^^. Since 2"^^ < 2 x 2""^, by Proposition 4.11, 
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the Markov bases for /ri,2 and Ir2,2 are slow- varying with respect to the Markov basis of 
-^rinr2,2- The set of glue moves consists of 4 binomials of degree 2"'"^. 

The simplicial complex F appearing in the associated codimension zero toric fiber 
product has [n] as an additional face. Consequently it consists of the boundaries of two 
{n — l)-dimensional simplices that share a single facet. By part (1) of Lemma 5.3, the 
Markov basis of the boundary of an (n — 1) -dimensional simplex consists of a single 
element of degree 2". The lifting operation preserves degree and produces 2^" elements per 
boundary simplex, for a total of 2^"+^ elements of degree 2". Finally, there are 2" quadrics 
in Quad. Theorem 4.12 shows that the union of all these elements is a Markov basis. □ 

The simplicial complex Bn is the boundary of the polytope that is a bipyramid over a 
simplex. In particular, it is a simplicial sphere. Theorem 5.5 and the results of [26] provide 
evidence for the following conjecture. 

Conjecture 5.6. Let T be a triangulation of a sphere of dimension n. Then the Markov 
basis of /r,2 consists of elements of degree at most 2"+^ . 

To conclude this section, we give an example which shows how the gluing operation can 
produce Markov basis elements of larger degree than either of the constituent binomials. 

Example 5.7. Let G be the graph with vertex set [5] and all edges except 1-5, and 
assume that d = 2. Thus, G consists of two K^^ graphs glued along an empty triangle. 
The Markov basis for K4, consists of 20 elements of degree four and 40 elements of degree 
six. The overlap triangle is the boundary of a simplex, whose Markov basis consists of a 
single element of degree four. Since 6 < 2 x 4, by Proposition 4.11 the Markov bases of 
each of the are slow- varying. Consider the following two binomials in the ideal of ^^4: 



'1 


1 
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1" 




'1 


1 


1 


2" 
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1 


2 


2 
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1 


2 


1 


2 


2 


1 


2 




1 


2 


1 


1 


2 


2 


2 


1 




2 


2 


2 


2 


1 


1 


1 


1 




2 


1 


1 


1 


1 


2 


2 


2 




2 


2 


2 


2 



'1 
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1" 




'1 
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2 


1" 


1 


2 


2 


1 




1 
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2 


2 


1 


2 


1 




2 


1 


1 


2 


2 


2 


1 


2 




2 


2 
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2 


1 


1 


2 


2 




1 


1 


2 


1 


2 


2 


1 


2 




2 


2 


1 


1 



The first sextic comes from the on vertex set {1,2,3,4} and the second one from the 
on vertex set {2, 3, 4, 5}. In the columns corresponding to {2, 3, 4} they agree in the 



first four rows and disagree in the last two rows. 



produce 


moves of deg 


ree 


4 + 2 + 2 


= 8. 


■1 1 


1 


1 


1 ■ 




■1 


1 


1 


2 


1 ■ 


2 1 


2 


2 


1 




1 


1 


2 


1 


2 


2 2 


1 


2 


1 




1 


2 


1 


1 


2 


2 2 


2 


1 


2 




2 


2 


2 


2 


2 


1 1 


1 


1 


nil 




2 


1 


1 


1 


mi 


1 2 


2 


2 


1712 




2 


2 


2 


2 


7712 


ii 1 


1 


2 


2 




ii 


1 


1 


2 


1 


12 2 


2 


1 


2 . 




i2 


2 


2 


1 


1 . 



This means that upon gluing these 
In particular we get 



ii,i2,mi,m2 G {1,2}. 



In this example gluing yields degrees four, six, and eight. Lifting produces Markov basis 
elements of degrees four and six. Direct computation with 4ti2 shows, however, that a 
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minimal Markov basis of this model contains only binomials of degree two, four, and six. 
Therefore the gluing operation may produce elements of unnecessarily large degree. 

5.2. Cycles and ring graphs. In this subsection, and the next, F = G is a graph. We 
start with cycles and graphs that can be easily constructed from cycles, then explore 
ii'4-minor free graphs, providing a new proof of the main result in [20] . To set up induction 
we provide the Markov bases of simple graphs. 

Lemma 5.8. Let P be a path and d e Z>2 arbitrary, then ii{P, d) — 2. 

Proof. A path is a decomposable simplicial complex, so this follows from [7, 35] . □ 

Lemma 5.9 (Small Graphs). 

(1) Let be the triangle. The following table contains known values of fi{K^,d): 



di 


2 


3 


3 


3 


3 


4 


d2 


p 


3 


3 


3 


4 


4 


ds 




3 


4 


g > 5 


4 


4 




min(2p, 2q) 


6 


8 


10 


12 


14 



(2) If C is a four-cycle with edges 12,23,34,41, then ii{C,d) takes the following values 



di 


2 


2 


2 


2 


2 


2 


2 


3 


d2 


2 


2 


2 


2 


2 


2 


3 


3 


ds 


3 


3 


3 


4 


4 


5 


3 


3 


di 


3 


4 


5 


4 


5 


5 


3 


3 


KC, d) 


6 


6 


6 


8 


8 


10 


6 


6 



(3) If C is a five-cycle with edges 12, 23, 34, 45, 51, di — d2 — 2, and d^ — d^ — d^ — 3, 

then /d{C, d) = 6. 

(4) Let K2,3 be the complete bipartite graph on {1,2} and {3,4,5}. If di — d2 — 3 and 
ds = d^ = d^ = 2, then iJ,{K2,3, d) = 6. 

(5) The complete graph K4 with d = 2 satisfies ii^K^, 2) = 6. 

Proof. The computation for with d = {2,p,q) is contained in the original work of 
Diaconis and Sturmfels [6]. The values for d — (3, 3, g) were determined by Aoki and 
Takemura [2]. All other values have been computed using 4ti2 and Markov bases are 
available on the Markov Basis Database [18]. □ 

Lemma 5.10. Let G be a graph, and Vi, V2 V such that ViUV2 = V, G — Gvi U Gv2 
and either \4 fl V2 = {u} or Vi fl V2 = {u, v} with uv an edge of G. Then 

n{G,d) = max(2,/x(Gvi,o?yi),/^(Gy2>o^y2))- 

Proof. In either case I^d is a codimension zero toric fiber product, which also in this setting 
is a reducible hierarchical model. The result then follows from either of [8, 15, 32]. □ 

Lemma 5.11. Let G be a graph, and Vi, V2 '^V such that ViUV2 = V, G = Gy^ U Gy^ 
and Vi n V2 = {u, v} where uv is not an edge of G, and suppose that du — dy — 2. Further 
suppose that fiiGvi^dv^) = fi{Gv2,dv2) = 2. Then 

IJ,{G,d) < max(2,/x(Gv^ U tiv, dvi), /^(Gyj U 'W'^^) c^vi))- 
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Proof. The intersection of Gvi and Gvb is the graph with two nodes, and no edges. Since 
du = dv = 2, the dimension formula (4) imphes that this is a codimension one toric fiber 
product. The toric ideal of the graph consisting of two isolated nodes, and du = dy = 2 
is generated by a single quadratic binomial, by Lemma 5.3. Furthermore, the fact that 
fi{Gvi, dvi) = fi{Gv2, dv2) = 2, and that hierarchical models have no Markov basis elements 
of degree one, implies that the Markov bases of Igv^Av^ ^^"^ -^Gyj.dvz slow- varying, by 
Proposition 4.11. Hence Theorem 4.12 shows that the Markov basis of Ig4 consists of 
the glued elements of the Markov bases of Icy^ ,dvi Icy^ ,dv2 ' together with the Markov 
basis of the associated codimension zero toric fiber product, which is 

lGUuv,d = IgviUuv^Vi lGv2^uv,dv2i 

by Proposition 5.2. Since we only ever glue quadrics along a quadric, the resulting binomial 
is also of degree two. The generators of the associated codimension zero toric fiber product 
consists of quadratic elements and lifts of generators of lGvi'ouv,dv^ and /cvjUntJ.dva- Since 
lifting preserves degrees, quantity max(2, yu(G'yjU , dy^), ^i{Gv2^ uv , (iy-a)) is the maximum 
degree of a generator of the associated codimension zero toric fiber product. □ 

Lemma 5.12. Let C he a cycle on vertex set V and d G Zi>2- 

(1) If C contains no edge uv with du^id^ > 2 then fi{C,d) = 4. 

(2) // all (it, < 3 and C contains no path U1U2U3U4 with all du^ > 2, then fi{C,d) < 6. 

(3) // all (it, < 4 and C contains no path U1U2U3 with all du^ > 2, then fi{C, d) < 8. 

(4) // all dj; < 5 and C contains no path U1U2U3 with all du^ > 2, then fi{C, d) < 10. 

Proof. We give a detailed proof of (1). According to Lemma 5.9 the statement holds for 
cycles of length three. We proceed by induction on the length of C. There are always two 
non-adjacent vertices u and f in C with du = d^ = 2. Let Vi be the set of vertices on one of 
the paths in C from u to v, and let V2 be the set of vertices on the other path. According 
to Lemma 5.8 the Markov width of paths is two. By induction we find fi{Gvi U uv, (iyj = 4 
and ii{Gv2 U uv,dv2) = 4, since those graphs are shorter cycles than C satisfying the 
conditions in (1). By Lemma 5.11, the Markov width of fi{C,d) = 4. Statements (2)-(4) 
follow by the same inductive argument and reducing to the small graphs in Lemma 5.9. □ 

Cycles can be patched together to form larger graph classes, for example ring graphs. 

Definition 5.13. A ring graph is a graph that can be recursively constructed from paths 
and cycles by disjoint unions, identifying a vertex of disjoint components, and identifying 
edges on disjoint components. An outerplanar graph is a graph with a planar embedding 
such that all vertices are on a circle. 

Outerplanar graphs are also characterized as the largest minor closed class that excludes 
Ki and -^"2,3- This in particular implies that all outerplanar graphs are series-parallel since 
they have no ii'4-minors. It is easy to see that outerplanar graphs are ring graphs. Recall 
that a graph is k-connected if there is no way to disconnect it by removing at most k — 1 
vertices. We need to describe how to decompose 2-connected ring graphs into cycles. 

Definition 5.14. A cycle decomposition of a 2-connected ring graph G is a sequence 
Ci, C2, . . . , Cfc of cycles in G such that 

• the union of all Gi is G, and 
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• the intersection of Ci U • ■ • U Cj and Cj+i is an edge for 1 < i < fc. 

Any 2-connected ring graph must have a cycle decomposition, since a 2-connected ring 
graph is obtained by only identifying edges in disjoint components. 

Theorem 5.15. Let G be a ring graph whose maximal 2-connected subgraphs are Gi, G2, . . . ,Gi 
and assume that C|, Cj, . . . ,Cl is a cycle decomposition of Gi for all 1 < i < I . If for all 

c = q, 

(1) there is no edge uv in C with du-,dv > 2 then fi{G,d) < 4. 

(2) all dy < 3 and there is no path U1U2U3U4 in C with all du^ > 2, then fi{G, d) < 6. 

(3) all dy < 4 and there is no path U1U2U3 in C with all d^ > 2, then fi{G, d) < 8. 

(4) all dy < 5 and there is no path U1U2U3 in C with all d^^ > 2, then fi{G, d) < 10. 

Proof. This follows directly from Lemma 5.8, Lemma 5.10, and Lemma 5.12. □ 

Definition 5.16. A graph G is Markov slim, if for every independent set I of G the model 
with dy > 2 for V E I and d^ = 2 for v G V{G) \ I has Markov width at most four. 

Theorem 5.17. The maximal minor-closed class of Markov slim graphs is the outerplanar 
graphs. 

Proof. By Theorem 5.15 the outerplanar graphs are Markov slim since they are ring graphs. 
Say that there is a minor closed class larger than the outerplanar graphs, in which every 
graph is Markov slim. Then this class either contains K^^ or -ft'2,3- By parts (4) and (5) of 
Lemma 5.9 neither nor 7^^2,3 are Markov slim. □ 

Repeated toric fiber products of cycles reduce computations of the Markov width to the 
three cycle. Therefore the following conjecture seems natural. 

Conjecture 5.18. Let G he a cycle of length n, with edges 12, 23, . . . , nl. Then the 
Markov width /i(C, d) equals 

max fi{K3,{di,di+i,di+2)) 

i=l,...,n 

where the indices i,i -\- l,i -\- 2 are considered cyclically modulo n. 

Our results so far only work with codimension one toric fiber products, which do not 
raise the degree of generators in the cycle case, and hence we always glued paths at a pair 
of vertices u,v where d^ = d^j = 2. It is not clear whether or not this remains true for 
larger values of du,dy. 

5.3. Binary series-parallel graphs. To prove Theorem 1.1 we apply a classical decom- 
position of K4-mmoT free graphs. 

Definition 5.19. The class SP of connected series-parallel graph is the smallest collection 
of graphs satisfying the following properties. 

• Each graph G G SP has two distinguished vertices the top and the bottom vertex, 
which are different. 

• The graph K2 is in SP. 

• If Gi and G2 are in SP with tops and bottoms ti,t2, &i,&2 respectively, then 
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Series construction: the graph obtained from Gi and G2 by identifying ti and 
62 and caUing bi and t2 the new bottom and top also belongs to SP; 

Parallel construction: the graph obtained form Gi and G2 by identifying ti 
and ^2 and bi and 62 (and calling these the new top and bottom) is also in SP. 

In a graph without i^4-minors, every 2-connected component is a series-parallel graph. 
Since gluing two graphs at a vertex is a codimension zero toric fiber product, to prove 
Theorem 1.1, we can restrict to series-parallel graphs. One tool is the following lemma 
about choices that can be made in the parallel construction. 

Lemma 5.20. Suppose that G G SP has at least four vertices. Then G can be obtained by 
series or parallel construction from two graphs Gi and G2 each with fewer vertices than G. 

Proof. The series construction of Gi and G2 clearly produces a graph G with a larger 
number of vertices. For the parallel construction, if both Gi and G2 are not single edges 
then their parallel construction has more vertices than either Gi or G2. The only non-trivial 
case is when one of the two graphs, say Gi, is a single edge. 

We can assume G2 is neither a path of one or two edges, nor K3, since then the resulting 
graph would have less than three vertices. The graph G2 is obtained either by a series 
or by a parallel construction from two graphs G^ and G4. In the case of a parallel 
construction, consider new graphs G3 and G4 with an edge glued in from t to 6 in both 
cases. The resulting parallel construction of G3 and G4 gives the same graph as the parallel 
construction of Gi and G2. In the case of a series construction, one of the graphs G3 or G4 
has > 3 vertices. Assume that graph is G4. A series construction of Gi with G3 followed 
by a parallel construction of the result with G4 gives the original graph. We may have to 
rearrange the tops and bottoms during this construction, but doing so does not change 
the property of being a series-parallel graph. □ 

Theorem 5.21. If G is a connected series-parallel graph with top t and bottom b, then 
fi{G, 2) = 4 and a Markov basis of 1^,2 can be chosen to consist of: 

(1) Degree four binomials whose terms have the same degree on the bt subcomplex. 

(2) Degree two binomials that are slow-varying on the bt subcomplex. 

Proof. We proceed by induction on the number of vertices of the graph. The statement is 
trivially true for connected series-parallel graphs with one or two vertices, since they have 
empty Markov basis. There are two graphs with three vertices to consider. For the triangle 
lKi,2 there is one degree four generator and it must project to the zero polynomial along 
the bt edge, since that edge belongs to K^. In the case of the path with three vertices, 
there are two quadratic generators, which are necessarily slow-varying. 

Now let G be a series-parallel graph with at least four vertices. By Lemma 5.20 it can 
be built from two graphs Gi and G2 with strictly smaller numbers of vertices by either a 
series or a parallel construction. We must show that properties (1) and (2) of the Markov 
basis are preserved under either of these constructions. 

First suppose that G is obtained from Gi and G2 by a series construction. There are 
three types of generators that arise. The generators are given by: 

Lift 1: lifting generators from /gi,2 while being constant on G2; 
Lift 2: lifting generators from /g2,2 while being constant on Gi; 
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Quad: quadratic moves. 

Lifting preserves degrees, so we obtain only moves of degree two and four. All quadratic 
moves are necessarily slow-varying, thus we must show that the degree four moves can be 
chosen so that their projections onto the bt edge are constant. The crucial idea is that the 
degree four generators always come from three-cycles, since with at least four vertices we 
are always only using series or parallel construction. The quartic generator for 1x^,2 is 
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l" 
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Any subsequent appearance of a quartic is a lift of this move in some way and must be 
obtained by using a single edge or vertex in and performing a sequence of lifts. The 
pair bt cannot go from an added vertex to the third vertex of the underlying K^, otherwise 
we would be able to construct graphs that have K4 as a minor. Thus, b and t belong to 
the gluing edge, or a subset of the lifted vertices. However, by construction of the lift 
operation, the binomial projects to zero when restricted to such a subset of vertices. 

If G is obtained from a parallel construction of Gi and G2, then the top and bottom 
vertices could be adjacent or not. If they are adjacent, then we are gluing two graphs along 
and edge. All generators in /gi,2 and /g2,2 project to zero along this edge by properties of 
the lift operation. 

If the special vertices are not adjacent we use the codimension one toric fiber product. 
The associated codimension zero toric fiber product also consists of series-parallel graphs 
with fewer vertices. By the argument in the preceding paragraphs, all Markov basis 
elements obtained from the associated codimension zero toric fiber product satisfies either 
(1) or (2). Finally, consider Glue(J-', Q). Since all Markov bases satisfy (1) and (2), we only 
ever glue quadrics, which produces a quadric satisfying the slow-varying condition. □ 

Instead of using binary variables for the triangle in the proof, one could have used larger 
values of dy on the vertex of the triangle that is never involved in gluing or identification. 
This would have given an alternative but less descriptive proof of Theorem 5.15. The 
procedure yields a larger class than ring graphs, but it is not true that larger on 
independent sets always produce Markov width four, as illustrated earlier by the fact that 
7^^2,3 is not Markov slim. 

There are further applications of higher codimension toric fiber products in algebraic 
statistics lurking. For example, ideals of graph homomorphisms [11] generalize classes 
of toric ideals in algebraic statistics. Given graphs G and H, potentially with loops, the 
ideal of graph homomorphisms from G to H is Iq^h- In this language, binary hierarchical 
models arise as the special case where H = K2 is the complete graph with loops. If H is an 
edge with one loop, then the homomorphisms from G to H correspond to the independent 
sets of G. It is known that Ig^h is quadraticaUy generated if G is bipartite, or becomes 
bipartite after the removal of one vertex [11]. Using the Theorem 5.21 as a template, one 
derives that Ig-^h is quadraticaUy generated for series-parallel G. 
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6. Application: conditional independence ideals 

A basic problem in the algebraic study of conditional independence is to understand 
primary decompositions of Cl-ideals. For instance, if a conditional independence model 
comes from a graph, the minimal primes provide information about non-obvious families 
of probability distributions that satisfy the conditional independence constraints but do 
not factorize according to the graph. Moreover, primary decompositions can provide 
information about the connectivity of random walks using Markov subbases [19]. 

In this section J is the generic letter denoting an ideal. This is to avoid confusion 
between the ideals Iq of Section 5 and the Cl-ideals Jq in Section 6.2. The results in this 
section are independent oi d = {dv)v^v, the vector of cardinalities. It is fixed arbitrarily 
and does not appear in the notation. 

Assume is a conditional independence model and Jm its Cl-ideal. Our goal is to 
describe conditions under which there exist suitable conditional independence models M.i 
and M.2 such that 

Jm = Jmi Jm2- 

If we realize Jm as a toric fiber product, then the results of Section 3 construct a primary 
decomposition of Jm from primary decompositions of Jmi and Jm2? greatly reducing the 
computational efforts necessary. This seems to work best in the case of codimension zero 
toric fiber products. At this moment it is not clear if there is a use for higher codimension 
toric fiber products in analyzing conditional independence models. 

We first develop a general theory for arbitrary conditional independence models. Then 
we apply it to global Markov ideals of graphs, showing that they are toric fiber products if 
the graph has a decomposition along a clique. 

We assume the same setup as in Section 1.1 for hierarchical models. Let A,B,C 
be three pairwise disjoint subsets of V, and D := V \ {A U B U C). If D 7^ 0, then 
Pi^igic+ ■= J^ioeDDP^AiBiciD- The conditional independence (CI) ideal J a±b\c is 

J A±B\C '■= {PiAiBic+PjAjBic+ ~ PiAjBic+PjAiBic+ '■ '^A.jA ^ ^aJbJb ^ ^bJc ^ ^c) ■ 

An argument similar to that in Section 1.2 shows that this ideal is prime. For a collection 

M = {Ai±Bi\Ci,...,Ar.±Br\Cr} 

of Cl-statements, the Cl-ideal is the sum of the ideals of its statements: 

Jm = J Ai XBi |Ci H \- Ja r-^Br \Cr ' 

In statistics one is usually not interested in all of the variety of a Cl-ideal, but only its 
intersection with the set of probability distributions. The following properties of Cl-ideals 
imply well-known properties of conditional independence. 

Proposition 6.1. The following ideal containments hold: 

• Ja±b\c = Jb±a\c (symmetry); 

• Ja±bud\c 3 Ja±b\c (decomposition); 

• Ja±bud\c 3 Ja±b\cud (weak union). 

However the contraction property does not hold algebraically since 

Ja±b\cud + Ja±d\c 2 Ja±bud\c- 
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The algebraic structure of Ja±b\c\jd + Ja±d\c was analyzed systematically in [12]. 

6.1. Toric fiber products of Cl-models. Let A^i,A^2 be conditional independence 
models on two (not necessarily disjoint) sets of variables ^i, V2, respectively. The Cl-ideals 
Jmi and live in polynomial rings with variables indexed by Dy^, and Dva, respectively. 
Their toric fiber product is again a Cl-ideal when certain conditions are satisfied. Our aim 
is to define the toric fiber product of Jmi and combinatorially, using Cl-statements. 

Definition 6.2 (The S'-grading). Let S d V. The grading on the polynomial ring 
]K[pj : i G Dy] given by deg(j9j) = 6,^ G iP^ is the S- grading. The conditional independence 
model M. is S -homogeneous if each statement A 1^ B\C in Ai satisfies either S" C [AUC) 
or S C (BUC). 

Lemma 6.3. If Ai is S -homogeneous then Jm is homogeneous in the S-grading. 
Proof, het D = V\{A\J B\JC). The polynomial 

/ ~ PiAiBic+PjA3Bic+ '~ PiAjBic+PjAiBic+ 

is not homogeneous if SCiD ^ since expressions like Pi^igi^^ involve sums over terms with 
different D-degrees. Assuming that S* fl D = 0, the degree of all terms in the polynomial 

P'iAiBic+PjAjBic+ i^ ^iAnS«snS*CnS ~^ ^jAnSjBnsicnS- '^^^ degree of all termS in Pi^jgi^^Pi^jgi^,^ 

is Gi^^gjg^^i^^g + ^jAnsiBnsicns ' Thcse two degrccs are equal if and only if 5* C A U C or 
SCBUC. □ 

Example 6.4 (Homogeneity with respect to the S'-grading). Consider binary random 
variables V = {1,2,3}, where S = {1}. The statement 2 X 3 is given by the polynomial 

(Plll +P21l)(Pl22 +P222) - (Pll2 +P212)(Pl21 +P22l) 

which is not homogeneous in the S-grading. In contrast, the polynomial for 1 i 2, 

(PlU +Pll2)(P221 +P222) - (Pl21 +Pl22)(P211 +P212), 

is homogeneous of multidegree ei + 62. 

The following example shows how redundant statements can seemingly complicate the 
situation and why it is advantageous to work with minimal sets of Cl-statments defining 
a given Cl-ideal. However, solving the conditional independence implication problem is 
difficult in general [13]. 

Example 6.5. The converse of Lemma 6.3 need not hold. Consider the ideal J12X3, which 
is {l}-homogeneous. By Proposition 6.1 it equals the Cl-ideal ofA^ = {12i3,2X3} 
which does not satisfy the combinatorial conditions in Lemma 6.3. 

Our next goal is to define the toric fiber product of two S'-homogeneous conditional 
independence models A^i, A^2 where S = Vi nV2. To this end, consider the statement 

S = {iV,\S)±iV2\S)\S}, 

representing a separating property of S. A second class of statements appearing in the 
toric fiber product of A^i and Ai2 comes from joining vertices in V2 to statements in Aii 
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and vice versa. By S*- homogeneity and symmetry in Proposition 6.1 we can assume that 
each statement A JL B \C inA^i,A^2 satisfies An S = ^ and define 

Ci = {A±BU{V2\S)\C : A±B\C G Mi} , 
C2 = {A±BU{Vi\S)\C : A±B\C eM2}. 

The Cl-statements in (5) are constructed so that their ideal generators are exactly the 
lifts of ideal generators associated to the statements in Aii and Ai2- The straightforward 
definition of Lift in the non-binomial case is contained in [32]. 

Lemma 6.6. Jc, = (Lift(A^i)). 

Proof. We only show the argument for Aii. Denote D = V2 \ S. Lifting a polynomial 
consists of choosing two configurations in, jo G D/j, and lifting to: 

(6) ^iAiBiciD + ^jAjBicjD+ ~ ^iAjBicjD + ^jAiBiciD+ ^ Lift(A^l), 

where in, jo align with the configurations ib and Jb by our convention that S G B U C. 
The lift (6) originates from one of the statements in £i and every statement there produces 
generators of the given form. □ 

Definition 6.7. The Cl-model on Vi U V2 given by all derived statements 

Ml XsM2 ■.= SUCi UC2- 

is the toric fiber product of Mi and M2 along S. 

Theorem 6.8. For 2 = 1,2 let Mi be an S -homogeneous Cl-model where 5 = Vi fl // 
A is the linearly independent matrix representing the S-grading, then 

JM\XsM2 ~ Jm2- 

Proof. Homogeneity in the (codimension zero) S'-grading follows from Lemma 6.3. Now, 
the generators of the codimension zero toric fiber product on the right hand side follow 
from the descriptions in [32], and in Section 4.1 in the toric case. They consists of Lifts 
and Quads. Since the Quads correspond exactly to the independence statement S, the 
theorem is a consequence of Lemma 6.6. □ 

Example 6.9. Let Vi = {1,2,3,4} and V2 = {3,4,5,6}. Let 

Mi = {l X 3|{2,4} , 2 X 4|{1,3} } and = {3 X 5|{4,6} , 4 X 6|{3,5} }. 

Both Ml and M2 are {3, 4}-homogeneous. The toric fiber product Mi X|3 4} M2 is 

{ 1 X {3, 5, 6} |{2, 4} , 2 X {4, 5, 6} |{1, 3} , {1, 2, 3} X 5 |{4, 6} , 

{1,2,4} X 6|{3,5} , {1,2} X {5,6} |{3,4} }. 
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6.2. Graphical conditional independence models. Our main motivation for toric 
fiber products together of Cl-ideals comes from an application to the global Markov 
condition in graphical models. Let G be a simple undirected graph on the vertex set V. 

Definition 6.10. The global Markov ideal Jq is the Cl-ideal 

Jg = ^ J A±B\C- 

C separates A and B ui G 

Lemma 6.11. The global Markov ideal is a binomial ideal. 

Proof. If a statement is valid on G but does not involve all vertices, then it is the 
consequence of a valid statement that does use all vertices. Indeed, ii v E V \ {AU B U C) , 
then V cannot be connected to both A and B as then C would not separate. It is thus 
connected to at most one of them, say A. In this case A U {f } 1^ B\C is a valid statement 
for G. Now use the decomposition property, also valid for Cl-ideals, A U {i} 1. B\C =^ 
A±B\C to get the resuh. □ 

Assume that we can decompose the vertex set of G as = U V2, such that the 
induced subgraph on 5 := Vi fl V2 is complete, and any path from Vi to V2 passes S. In 
this case 5* is a separator. Since a global Markov ideal is binomial it is 5'-homogeneous, 
and the same holds for the Cl-ideals Jq^ and Jgj, arising from the induced subgraphs on 
Vi and V2. 

Theorem 6.12. Let G be a graph with vertex set V = V1UV2 and let S* = fl V2 be a 
separator. Let Gi and G2 be the induced subgraphs of G on vertex sets V\ and V2 . Then 
Jg is the toric fiber product 

Jg = Jgi Jg2 
where A is the matrix associated to the S- grading. 

Proof. It is easy to check that all Cl-statements defining .Jq^ by Theorem 6.8 

are valid on G and thus Jg ^ Jgi Jg2- For the other containment let A 1^ B\G be 
a saturated independence statement implied by the global Markov condition on G. If 
A '^Vi, then A JL B \G is implied by Ci since 

A±B\{V2\S)\C\iV2\S) 

is a global Markov statement on Gi. After potentially replacing it by its symmetric version 
and lifting we find 

A±BU{V2\S)\C\{V2\S) eU 
By the weak union property in Proposition 6.1, Ja±b\c is contained in J^^. Note that if 
B \ (V2 \ S") = 0, then the resulting Cl-statement is implied by 5. If B C Vi, A C V2, or 
B G V2 then A 1. B \C is similarly implied by Ci or £2- 

It remains to consider the case that both A and B have non-trivial intersection with 
both Vi \ S" and V2 \ 5'. Since the subgraph induced on S is complete, we can assume that 
An S = ^. Let Ai = An Vi, i = 1,2 and a binomial associated to A JL B \G has the form 

/ ~ PiAiiA2iBicPjAijA2jBic ^ PiA^iA2jBicPjA^jA2iBic- 

The independence statements 

Ai ± BU A2\C and A2±BUAi\C 
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are both valid in G, since any path from Ai to A2 must traverse S, and all such paths are 
blocked either before they get to fins', or at CDS. By the argument in the first paragraph 
of the proof, the first statement belongs to and the second statement belongs to J^j. 
Together they imply / G Jci + Jc2 since 

/ ~ iPiAiiA2iBicPjAijA2JBic ~ PiAijA2JBicPjAiiA2iBic) 

'^iPiA^jA23BicPiA^iA2iBic ~ PiA^iA2iBicPjA^jA2iBic)- 

Thus, all binomials from saturated Cl-statements implied by G belong to J^i Jg2- ^ 

As an immediate corollary we get the following known result [7, 35]. 

Corollary 6.13. The global Markov ideal of a chordal graph is prime. 

Proof. A chordal graph decomposes as a product of its maximal cliques. Inductively 
applying Theorem 6.12 and the fact that the toric fiber product of geometrically prime 
ideals is geometrically prime, gives the result. □ 

The following corollary was one of our initial motivations for this section and Theorem 3.1 

Corollary 6.14 (Primary decompositions of graphical Cl-ideals). Let G be a graph with 
vertex set V = Vi U V2 with Vi D V2 a separator in G. Let Gi and G2 be the induced 
subgraphs on V\ and V2 respectively. A primary decomposition of Jq can be obtained from 
toric fiber products of the primary components of Jqi and Jg2 ■ 

As the primary decompositions of the Cl-ideals Jg are unknown for most graphs, we do 
not know in which situations we can guarantee that the toric fiber products of irredundant 
primary decompositions of Cl-ideals yield an irredundant primary decomposition. In 
concrete situtations Corollary 3.3 and Lemma 3.4 can be used. For instance the primary 
decomposition of the chain of squares in Example 1.3 is irredundant. Explicit computation 
shows that none of the eight monomial minimal primes contains all monomials of a given 
multidegree, and the same holds, of course, for the toric ideal. By Corollary 3.3 the toric 
fiber products of the prime components yield an irredundant prime decomposition of the 
ideal of two squares glued along an edge. When gluing the next square the grading is 
different, but Lemma 3.4 guarantees that the hypothesis of Corollary 3.3 is still fulfilled. 
Unfortunately this argument cannot be applied to all conditional independence models, as 
the following example demonstrates. 

Example 6.15. Consider the the binary graphical conditional independence model of the 
complete bipartite graph -^'3,2, labeled such that {1,2,3}, and {4,5} are independent sets. 
The Cl-ideal Jks2 is radical as a computation with Binomials shows [17]. Consider the 
edge 1-4. Its induced grading takes values in N^. The homogeneous elements 

P11111P11212P21122P21221 — P11112P11211P21121P21222, 

P11121P11222P21112P21211 — P11122P11221P21111P21212 

witness minimal primes Pi, P2 with the property that (-Pi)a = lK[p]a for all a G N{ei2, 621} 
while (-P2)a = lK[p]a for all a G N{eii,e22}- The prime decomposition of the toric fiber 
product, given by the toric fiber products of the minimal primes of two copies of 37 has 
a component Pi P2 which equals the maximal ideal of the fiber product's polynomial 
ring, and is thus redundant. 
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